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HIGHLIGHTS OF THE REPORT 



Studen^ ovtco-ties data are Important requisites for institutional plan- 
nlngt developing student retention and recruitment strategies, evalu- 
ating thQ effectiveness of Institutional programs, and preparing for 
accrfjdltation reviews. 

A project team consisting of a faculty member and graduate students 
from The Ohio State University College of Education worked with admin- 
istrators of the Ohio Dominican College to design and pilot test a 
questionnaire to determine the Impact of the College on graduates. 

The 101 item survey contains objective Information regarding back- 
ground characteristics, activities during college, and endeavors after 
graduation. Also, it contains subjective data about topics such as 
satisfaction wtth college; critical thinking and expression; interper- 
sonal skills; and values, goals and philosophy. 

Twelve respondents completed the pilot survey. The final draft of che 
survey included in this report contains revisions based upon comments 
and suggestions from respondents and college administrators. Reaction 
of the graduates to the questionnaire was very favorable. 

In order to determine the Uipact of Ohio Dominican College on its 
recent graduates a procedure is presented for conducting a mail survey 
of graduates. Specifically, 935 graduates should be surveyed by mail 
questionnaire during Spring 1986. 

The cost of materials and professional printing for such a study will 
be approximately $1256 or $2355. The two estimates reflect different 
specifications for the questionnaire sych as size and layout which may 
significantly affect the decision of a graduate to respond. 
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INTRODUCTION 



Higher education administrators^ faced with declining numbers of college- 
aged students. Increasing competition for those students, and shrinking 
Institutional resources, have become Increasingly concerned with assessing 
the Impact of their programs upon students. Although the benefits of 
measuring student outcomes are numerous, four stand out as salient: con- 
tributions to Institutional planning, development of student retention and 
recruitment strategies, evaluation of the effectiveness of programs within 
the Institution, and preparation for accreditation reviews (Ewell, 1983). 
By using student outcomes data, higher education Institutions can benefit 
from Identifying both what they do well and what they do that could be 
Improved. 

In recent years many administrators and faculty at colleges and uni- 
versities have become Involved In conducting research on student outcomes 
data. One such study was coiT:pleted by Ohio Dominican College In 1977. 
Conducted by the Office of Institutional Research at the College, It 
enabled Ohio Dominican College to assess the Impact of the college exper- 
ience on Its graduates and alumni and to evaluate the quality of its 
programs. The study also provided data for the regional accrediting body, 
the North Central Association of Colleges and Secondary Schools. 

Now, eight years later the leadership of the college, committed to 
providing a quality undergraduate experience for Its students Is again 
seeking Information about student needs and satisfaction. The present 
effort, however. Is a collaborative effort In which persons outside the 
College, a faculty member and graduate students from The Ohio State Unl- 
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versltyf are working with administrators of Ohio Dominican College to 
undertake a self-study on student outcomes. Consequently^ the metamorpho- 
sis of the study Is more elaborate and Its accompanying documentation more 
thorough than that associated with most single Institution efforts to 
study the impact of college on students. 

The following pages present (1) an account of how the Ohio State 
project team developed a survey of college graduates and (2) specific 
Information necessary to conduct a successful study of college graduates. 

Three goals guided the project. The first goal was for the project 
team to develop a graduate survey Instrument for Ohio Dominican College 
which could later be used to generate self-study data for the North Cen- 
tral Association of Colleges and Secondary Schools Accreditation review In 
1987-88. Such self-studies are Important because accrediting bodies "are 
increasingly Interested In assessing the degree to which Institutional 
activities meet student needs .... Indeed* some accrediting bodies have 
begun to tfe evidence of outcomes pi^rformance to accreditation standards" 
(Ewell# 1983# p* 49). The second goal of the project team was to 
develop a study which would generate results to assist Ohio Dominican 
College In assessing how well It Is accomplishing Its mission. Student 
outcomes data can be used to assess the extent to which elements of 
Institutional mission are being attained. The third goal of the project 
team was to provide Ohio Dominican College with a management tool which 
may be used over time and can be adapted by the Institution to evaluate 
the effectiveness of specific programs. 
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PROJECT MANAGEMENT 



The Initial step in the development of the project was the formation 
of a management subcommittee to organize the project* in order to assure 
development of the survey# as requested by Ohio Dominican College* a 
management plan was created. This plan Included a comprehensive list of 
P'^oject tasks and a timeline through vehlch the survey development* pilot 
study Implementation* survey revision* and final report would be com- 
pleted. July 31 was established as the target completion date (see Appen- 
dix A). The management subcommittee also established four additional 
subcommittees to carry out the plan. These subcommittees and their pri- 
mary responsibilities were: 

SURVEY SUBCOMMITTEE - This committee reviewed current survey litera- 
ture and developed and pilot tested the "Ohio Dominican College Graduate 
Survey." The subcom.nlttee carefully Integrated material from the higher 
education and social science literatures* Information from records and 
publications of the College* and tho expressed needs of representatives of 
the Ohio Dominican community to cor^ceptuallze and design the survey. 

COMMUNICATION SUBCOMMITTEE - With the help of the Ohio Dominican 
College Alumni Offlcei^ this subcommittee coordinated the Implementation of 
two pilot surveys and conveyed Information from participants to the Survey 
Subcommittee for further revisions to the questionnaire* 



IMPLEMENTATION SUBCOMMITTEE - The Implementation Subcommittee reviewed 
current literature appropriate to correct Implementation of mall surveys 
and determined the human and physical resources necessary to conduct a 
large scale survey of graduates. The committee also made recommendations 
for Implementing the survey and effectively using the the student outcomes 
Information which would emerge from the questionnaire. 

DRAFTING SUBCOMMITTEE - The role of the Drafting Subcommittee was to 
Integrate the efforts of the Individual subcommittees Into a written 
document and an oral presentation which would adequately convey a sense of 
both the process and product of the project team* 

KEEDS ASSESSMENT 

To understand and meet the needs of the Ohio Dominican administration 
and ground the development of the survey In the context of the Institu- 
tion* the Project Team met with a number of College officials to solicit 
their views about content relevant to the survey of graduates* The group 
met with Sister Suzanne Uhrhane, Director of Institutional Research; Mr* 
George Hertrich. Acting Vice President for Academic Affairs; Mr* James 
Sagona, Dean of Admissions and Students; and Ms* Toni Hale* Assistant to 
the Director of the Alumni Office. These interviews suggested that indi- 
viduals held a diverse set of views on the information that should be 
acquired through the survey. Among the topics recommended to be studied 
were: 

- graduates' use of and satisfaction with college services and stu- 
dent organizations; 
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- graduates' needs and perceptions of the Alumni Association and Its 
programs and services; 

- graduates' arsessment of the Humanities curriculum; 

- an analysis of the Weekend College; 

- and the Impact of the International students on the Ohio Dominican 
College campus; 

Although each of these topics contributed significantly to the practi- 
cal grounding of the survey^ It was the stated mission of the College as a 
Dominican Catholic and liberal arts Institution which was most ijallent In 
shaping the content of the questionnaire. The Dominican emphasis on 
teaching and service* the nature of the curriculum^ and the concern for 
the development of the whole student* reflect the search for truth. This 
guiding principle of the College* embodied In Its Mission Statement was 
the common theme articulated by all officials of the College with whom the 
project members met* and shaped both the content of the survey questions 
and the process used by the Project Team. 

LITERATURE REVIEW 

In addition to the knowledge and Insights which the administrators of 
the College provided the Project Team* the team reviewed the rich litera- 
ture on student outcomes research to strengthen the foundations upon which 
the survey would be developed. Two primary works greatly Influenced the 
thinking of the project team and the development of the survey. The first 
was the CollggQ fijitcQjofi Measures Prolect of the American College Testing 
Program (ACT). The ACT Information on satisfaction; abilities* skills* 
and competencies; and personal growth provided much of the basis for 
sections of the "Ohio Dominican College Graduate Survey.'* Also* a m«Jor 
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portion of the Occupational Information section of the ACT survey was 
adapted for the "Ohio Dominican College Graduate Survey." 

The second primary work which influenced the development of the survey 
was Measuring tha. QiiiSiSmss, si /lalUaa by C. Robert Pace (1979). To gen- 
erate many of the content areas and specific questions contained In the 
"Ohio Dominican College Graduate Survey*" the Gurvey Subcommittee used 
Pace's list of student outcomes measures which Included: 

- Occupational Level of Graduates 

- Income 

- Job Satisfaction 

- Relationship of Job to Ma.1or Field of Study 

- Vocational Relevance of College 

- Satisfaction with College and Attitude Towar'i College 

- Political Activities 

- Cultural Actlvl-cles and Interests 

- Critical Thinking and Expression 

- Breadth of Knowledge 

- Interpersonal Skills 

- Values* Goals* and Philosophy (pp. 96-105) 

In addition* the group Incorporated the following desirable outcomes of 
the college experience which Pace discussed: 

- clarification of one's philosophy* ethics* and morality 

- responsible citizenship 

- esthetic sensitivity 

- tolerance 

- appreciation of other cultures 
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- self-directed learning 

- understanding science and technology 

- vocational training (p. 110) 

Thus, the ACT Survey and work of C. Robert ^Pace provided the foundation 
for developing the content of the "Ohio Dominican College Graduate Sur- 
vey." 

SURVEY DEVaOPMENT 

In addition to developing the content of the mall survey, the wording 
of questions, ordering of statements, and general sequencing of the con- 
tent areas received careful attention. Substantial research has shown 
that these Issues do significantly influence how materials are perceived 
by potential recipients and their likelihood to participate in a mail 
survey (Dill man, 1978). Therefore, the Survey Subcommittee closely moni- 
tored these factors during the survey's development. 

The Survey Subcommittee sought to ground the needs of the administra- 
tors of Ohio Dominican College in the theoretical directions found in the 
literature on student outcomes and survey research. Again, it is impor- 
tant to note the primacy of the Mission Statement of the College in all 
aspects of the institution such as the curriculum and student services. 
Its application to the general workings of the College help to support the 
general nature of the instrument developed by the Survey Subcommittee. 
While it was Impossible to include all of the areas and topics suggested 
for consideration by Ohio Dominican College administrators, the Survey 
Subcommittee made a conscious effort to Include special interests in 
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questions througho it the survey. At the same time* the subcommittee 
attempted to address the entire educational experience of Ohio Dominican 
College graduates. 

A general, broad-based survey was created which many administrators 
and faculty of the College should be able to use. Moreover^ the Informa- 
tion gathered can serve as a foundation for the gathering of additional 
office-specific Information, Given the constraints of length, user time, 
readability, and the need to gather usable Information it was felt that 
the more broad-based, general student outcomes survey should be developed 
rather than a wore comprehensive Instrument* 

IMPLEHENTTATION OF THE PILOT STUDY 

After writing and revising several versions of each section of the 
survey, a draft of the entire questionnaire was prepared and revljsed. The 
revised questionnaire was then administered In a pilot study. 

Working from a list of six names supplied by the Alumni Office, the 
Communication Subcommittee contacted by telephone three graduates of Ohio 
Dominican who agreed to complete the survey In their homes and provide the 
committee with reactions. Interviews with these Individuals provided a 
wealth of valuable Information which was Incorporated Into the next revi- 
sion of the survey. 

Working with a list of thirty-two names provided by the Alu^Tinl Office, 
the Communication Subcommittee established an objective of administering 
the second pilot survey to ten to twelve Individuals. Eventually, nine 
persons participated In two different administrations of the second pilot 
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survey. After completing the questionnaire, participants were interviewed 
as a group. Their reactions to the survey were tape recorded for use by 
the Survey Subcommittee in making further revisions tc the survey. 

In the first administration of the second version of the question- 
naire# four out of six participating graduates went to the Ohio Dominican 
campus to complete the survey. The inability of several volunteers to 
participate caused the Communication Subcommittee to seek additional par- 
ticipants to achieve the desired sample size. However, no further volun- 
teers were found who could complete the survey at the scheduled times. At 
the second administration, five of six volunteers went to the campus to 
complete the survey. 

The total number of persons (twelve) completing the pilot surveys was 
considered adequate for testing and refining the questionnaire. It was 
felt that the use of a larger pilot sample would diminish the potential 
pool of graduates available to p^\rticipate in the official "Ohio Dominican 
College Graduate Survey" In the Spring of 1986. 

Two especially noteworthy issues were raised by the respondents after 
completing the survey. First* several volunteers expressed reservations 
about being identified by name on the survey. They Indicated that they 
would respond more candidly if their names were not on the questionnaire 
and if anonymity were assured. A second issue was the importance of the 
personal nature of the educational experience at Ohio Dominican College. 
Having become accustomed as students to this "personal touch", the gradu- 
ates felt that a very personal cover letter should accompany the mailed 
survey in order to encourage the greatest response rate. 

The Survey Subcommittee incorporated these two suggestions and other 
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recommendations concerning the wording of questions Into a revised version 
of the "Ohio Dominican College Graduate Survey" (Appendix B). Then Sister 
Suzanne Uhrhane and Mr. Sagona met with the subcommittee to discuss the 
questionnaire and make suggestions and additional changes. Once again, 
the Survey and Implementation Subcommittees used this Information to 
further refine the questionnaire and the recommendations for Its Implemen- 
tation. 

RtCOMMENDATIONS FOR CONDUCTING A STUDY OF GRADUATES 

The Intent of this section Is to serve as a blueprint for Implementing 
a survey of graduates. The recommended procedures presented are derived 
from scholarship or research methods In the social sciences, knowledge 
from Ohio Dominican College, and Professor Sagarla's expertise regarding 
survey research. Topics addressed Include sampling, survey mailing and 
follow-up procedures, costs for the project, and possible benefits from 
the research* 

Sample 

The recommended sample unit for the study Is all alumni who reside In 
the United States who graduated from 1978 through 1984. According to 
lists provided by the Alumni Office there are 953 Individuals meeting 
these two criteria. Persons residing outside of the U.S. are excluded 
because officials at the college are currently Involved with a project to 
solicit Information from them regarding their views about Ohio Dominican 
College. Also, there are serious difficulties associated with Implement- 
ing a survey using both domestic and International postal services. Loca- 
ting graduates outside the United States Is more difficult than within the 



U.S. Different mailing schedules also must be developed and there Is a 
greater probability of losing the survey materials sent outside of the 
U.S. than within the country. In addition, this sample unit has the 
advantage of Including the vast majority of Individuals who graduated 
since the last survey of graduates undertaken by Ohio Dominican College In 
1977. 

The sample unit of 953 graduates Is a manageable number for a mall 
survey. Also» It assumes representativeness of the recent graduating 
classes and responses from the entire cohort will serve as useful bench- 
mark data which could be augmented with Information from future graduates 
to establish patterns over time. Most Importantly, by surveying the 
entire sample unit officials of the college will have a rich data source 
that will lend Itself to analyzing the responses In many ways. Analyses 
by graduating class and major or graduating class and place of student 
residence are two such possibilities. 

When developing the sampling unit. It Is Important that the sample 
does not contain duplications of names of graduates. This might occur If 
a student graduated with more than one degree from Ohio Dominican College 
between the cut off dates of 1978 and 1984. Such duplications must be 
deleted from the survey list to avoid offending graduates with multiple 
mailings, miscalculating the response rate, and unnecessary costs. 
Hailing and Follow-up Procedure^ 

After the list of the sample unit has been generated, mailing proce- 
dures should follow the Total Design Method {T.D.M.). This describes the 
step-by-step details of how to conduct successful mall surveys. It offers 
specific guidance on how to carry out a mail survey (Dillman, 1978, 
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p. and should enable Individuals at Ohio Dominican College to suc- 

cessfully conduct their own survey. 

The recommended design for the study of graduates consists of an 
Initial mailing and three follow-up malllngso This design should double 
the response rates normally attained by mall surveys of special groups of 
college-educated respondents (Dlllman^ 1978* p. 180). If the College 
adheres closely to the recommended procedures outlined here and the Total 
Design Method* It Is reasonable to expect an overall return rate of 70 
percent* For Ohio Dominican College this percentage represents approxi- 
mately 650 graduates* 

The Initial mailing to the graduates should consist of a type set and 
printed survey In booklet form* a return envelope with a first class 
stamp* and a personalized cover letter. The survey In Its present form 
(see Appendix B) Is scientifically sound and should be understood by 
graduates. Content is* of course* the most salient characteristic of the 
questionnaire. However* other aspects such as size* color* and quality of 
paper* and the cover design and layout may significantly affect the grad- 
uate's decision to respond. 

Because the mail questionnaire* more than any other type of question- 
naire (such ds a face to face interview or telephone survey) must be its 
own advocate* the overall initial impact of the questionnaire must be to 
provide immediate and positive answers to concerns over its Importance* 
difficulty and length (Dill man* 1978* p. 120). Therefore* it is strongly 
recommended that visually observable characteristics of mailed question- 
naires that have been proven successful be incorporated in preparing 
surveys to be sent to all recent graduates of the college. 
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The questionnaire should be printed as a booklet in a photographically 
reduced form and reproduced on off-white paper by a printing method that 
provides quality similar to the original typed copy. The survey should 
also be designed to form a 6 1/4 x 12 1/4 inch booklet to fit well in 
mailing and return envelopes (Dillman, 1978, p, 121). Other considera- 
tions regarding specifications for the questionnaire may be found in Mail 
^ Telephone Surveys by Don A« Dill man, 

A personal cover letter should accompany the questionnaire. It should 
reinforce Ohio Dominican's tradition of personal interest in students and 
commitment to quality education, explain the importance of the graduate's 
participation, and the purpose of the study* The name, address, and 
salutation of the graduate should be individually typed onto the letter on 
the business stationary of the college. Letters should have a real signa- 
ture. The follow-up letters should be prepared in the same manner as the 
first cover letter and should articulate the value of the participation of 
the alumnus or alumna and how the acquired information will benefit the 
College. 

After the initial mailing is completed, certain follow-up procedures 
must be utilized in order to obtain the highest possible return rate. 
First* a tracking sheet should be developed to monitor the return rate of 
the surveys, to identify any complications that may occur early in the 
returns, and to allow identification of non-respondents for follow-up 
mailings. Tracking is made possible by using a coding number on each 
copy of the survey. 

The second procedure Involves the first follow-up mailing to gradu- 
ates. A postcard should be sent to all persons In the sample one week 
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after the Initial mailing reminding them of the survey and the Importance 
of Its completion and return to Ohio Dominican College, They should also 
be thanked for their participation because many may have already completed 
and returned the survey* 

Finally, a second follow-up should be mailed three weeks after the 
first .Tialling to those graduates In the survey group who have not yet 
responded. It should consist of a letter again stressing the Importance 
of completing the survey, another copy of the survey, and a return enve- 
lope* In the event that a graduate misplaces or did not receive the 
original copy, he or she will then have survey materials available to 
complete. 

It should be noted that a successful return rate can be positively 
Influenced by the timing of the Initial and follow-up mailings. It Is 
recommended that all mailings be made late In the work week so that mall 
Is received early In the week when persons are most likely to respond. 

In order for the survey to be carried out In a timely and effective 
manner, the responsibility for the Implementation of the survey should be 
placed with Individuals who can make the project their first priority. 
Survey projects of this magnitude typically demand greater time and effort 
than college employees with full appointments are able to commit. There- 
fore, It Is recommended that a small project team or graditate Intern be 
employed and provided with office space, telephone access, and needed 
secretarial support for the duration of the project. 

It Is also recommended that the Initial mailing of the survey be made 
In March of 1986 to avoid the Christmas holiday mall period and to allow 
for completion of the study by the end of the academic year. The survey 
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implementation ^s estimated to require 75 working days (these should not 
be confused with actual hours of work) excluding the time needed to hire 
personnel. An additional 10-15 working days may be required. Individuals 
who will work with the project should, therefore, be selected by the first 
week of February, 1986 In order to complete the study by early June, 1986* 
More specific Information regarding the recommended time line for the 
research appears In Appendix A contingency plan should also be devel- 
oped to take Into account potential problems and delays* 

Qosis, 

Other than personnel expenditures, the postage and printing of the 
survey and accompanying materials are the two major costs which will be 
Incurred by this project. It Is recommended that first class postage be 
used throughout the course of the project to further reduce expenses by 
ensuring priority handling by the postal service b> well as to communicate 
to the graduates the significance of the survey. Business reply envelopes 
should be used for the return of the survey which will reduce costs, since 
no postage Is lost If the graduate does not respond* 

The follow-up mailings account for a significant portion of the total 
cost of the project. These expanses can be kept to a minimum by using 
"reminder" postcards (rather than letters) for the first follow-up mail- 
ing. Also, thorough tracking of survey returns will ensure minimal dupli- 
cation of mailings. 

Despite the fact that offset printing expenses will be greater than 
mimeograph printing, surveys and postcards should be printed professional- 
ly* The professional appearance of printed materials conveys the Impor- 
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TABLE 1 

ESTIMATED PRINTING AND MAILING COSTS FDR A SMALL SURVEY BOOKLET 

(OPTION A) 



MATERIALS 



NUMBER 



INDIVIDUAL 
COST 



EXW.ANATION 



ESTIMATED COST 



Initial Mailing 

Cover letter 953 

Surveys 953 

Return envelopes 953 
(no. 9) 

Mailing envelopes 953 

First class postage 953 



Return postage 
(survey) 



477 



First Follow-up Mailing 

Post card 953 

Fiir^t class 953 
postage 

Second Follow-up Mailing 
Cover letter 477»* 

Surveys 477 

Return envelopes 477 
(no. 9) 

Mailing envelopes 477 

First class postage 477 

Return postage 190 



.36 
.05 

.22 
.29 



.03 
,14 



.36 
.05 

« 
.22 
-29 



Ohio Dominican Official 
Stationary 



BesinESS reply prnting cost 
special project address 

Jhio Dominican envelopes 

1 oz. package 



Printing costs 



Ohio Dominican Official 
Stationary 



Business reply printing cost 
special project address 

Ohio Dominican envelopes 

1 oz.> package 



343.08 
47.65 

* 

209. 66 
138. 33 



2ti. 59 
133.42 



171.72 
23. 85 

« 

104.94 
55. 10 



TOTAL $1,256.34 

NOTE: 

The Option A Booklet is 5 1/2 x 8 1/2 inches 
♦ » Materials Available through Ohio Dominican College 
^ » Estimated 50* of surveys wiil L« mturned from the initial mailing 
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TABLE 2 

ESTIMATED PRINTING AND MAILING COSTS FDR A LARGE SU'^VEY BOOKLET 

(OPTION B) 



MATERIALS 



NUMBER 



INDIVIDUAL 
COST 



EXPLANATION 



ESTIMATED COST 



Initial Maili>^o 

Cover letter 953 

Surveys 953 

Return envelopes 953 
(no. 9) 

Mailing envelopes 953 

First class postage 953 



Return postage 
(survey) 



477 



First Follow-up Mailing 
Post card 953 



First class 
postage 



Second Follow-up Mailing 

Cover letter 477** 

Surveys 477 

Return envelopes 477 
(no- 9) 

Mailing envelopes 477 

First class postage 477 

Return postage 190 



.63 
.05 



1 56 
.63 



.03 
.14 



.63 
,05 



.56 
.63 



Ohio Dominican Official 
Stationary 



Business reply prnting cost 
special project address 

Ohio Dominican envelopes 

3 oz. package 



Printing costs 



Ohir-i Dominican Official 
Stat ionary 



Business reply printing cost 
special project address 

Ohio Dominican envelopes 

3 oz. package 



600.39 
47.65 



533.68 
300.51 



28.59 
133.42 



300.51 
23.65 



267. 12 
119.70 



NOTE: 



TOTAL 



42,355.42 
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The Option B Booklet is 8 1/3 x 11 :/2 inches 
« » Materials Available through Ohio Dominican College 

Estimated 50% of surveys will be returned from the initial mailing 
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tance of the study and ensures that materials have a high quality appear- 
ance. Two estimates of costs associated with questionnaire and postcard 
printing and mailing are reported In Tables 1 and 2, Depending upon the 
preferred printing specifications, the approximate cost for materials 
using estimate A will be $1#256»34, and the costs for estimate B will be 
$2#355*42* These costs were derived from reasonable estimates for print- 
ing the materials In Columbus, Ohio. The two estimates represent differ- 
ent page sizes for the questionnaire, different point size, and different 
mailing costs associated with the two sizes of the questionnaire. Al- 
though estimate A Is more economical than estimate B, the survey form 
associated with estimate B Is larger and, therefore, more readable than 
that associated w^th estimate A. 

In addition, variable costs exist in the form of salaries for indivi- 
duals conducting the study and secretarial assistance, the renral of any 
needed equipment such as computers, and expenses for follow-up telephone 
calls to clarify Information or answer questions from respondents. The 
approximate cost estimates provided for postage and printing are currently 
accurate but are subject to change by the time the study will be under- 
taken. 

In partial summary, the Total Design Method (Dillman, 1978) recom- 
mended for conducting the survey affords a high probability of success for 
the survey of graduates. The costs associated with this procedure are 
Intended to assure a professional study vhich will produce a high response 
rate. It is the opinion of the project directors that the benefits of the 
costs associated with such an undertaking significantly outweigh a more 
economical approach to implementing the study. 



24 



POSSIBLE USES OF INFORMATION FROM A STUDY OF GRADUATES 
The data collected through the "Ohio Dominican College Graduate Survey" 
have the potential to provide valu^^ble Information to many segments of the 
Ohio Dominican College Community. The following are some of the potential 
uses and users of these data: 



Users 

1. Academic Deans and Director 
of Graduate Placement 



lisss. 

to examine academic areas which 
have been effective In placing 
students In Jobs and graduate 
programs related to their field, 
to work to Improve College efforts 
In areas which appear to be less 
effective. 



2. Dean of Admissions and 

Students and Members of the 
Student Affairs Staff ^ 



to examine satisfaction levels 
with services provided, 
to continue, by virtue of the 
above examination, to fund effec- 
tive services and bolster or re- 
examine Ineffective services, 
to examine some characteristics of 
satisfied users and determine the 
need to expand marketing to better 
serve other populations. 



3. Director of Admissions 



to develop recruiting strategies 
which focus upon aspects of the 
college which appeal to students 
(e.g., how graduates become promi- 
nent contributors to community, 
develop personal skills), 
to develop strategies for recruit- 
ment and retention of specific 
populations (e.g., race, ethnic- 
ity, socio-economic status, 
acaderrlc area* state/national 
locale). 
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4, Planning and Budget Review 



5. All Admlnlstratorr 



In conjunction with representa- 
tives of all constituencies* to 
determine how funds may be used 
more efficiently, 
to target specific alumni popula- 
tions for future budgetary 
development* 

to examine physical plant 
usages/ users and determine areas 
of potantlal need, 
to continue to examine existing 
and future goals of Individual 
offices to determine how well 
goals are being met and how well 
they relate back to the mission 
statement of Ohio Dominican 
College. 



These are Just some of the potential users and uses of Information col- 
lected from the survey^ Those persons more Intimately fainlllar with the 
College's resources and Internal workings of the college will be able to 
determine the most extensive and appropriate uses for the data. 
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CONaUSION 

In conclusion, the Intent of this report Is to provide a snapshot view 
of the process used to develop and test a survey of graduates of Ohio 
Dominican College. The actual activities of the Project Team were speci- 
fied and analyzed more carefully than the activities of the majority of 
Institutional research projects so that students could laarn from their 
experiences of conceptualizing designs, conducting a survey, and reporting 
a research project. 

The presence of the educational component has also served to reaffirm 
that high professional standards for the research were met. Therefore, 
the efforts to date should provide a sound foundation for undertaking a 
major survey of graduates. To this end, care has been taken to recommend 
a procedure for conducting such a study. Although the recommendation to 
survey953 graduates Is ambitious for a small liberal arts college. It Is 
consistent with the high quality of effort and standards of performance 
demonstrated by the administrators and graduates of the Ohio Dominican 
College with whom the members of the Project Team worked. 

It is the hope of th Project Team that the attached questionnaire and 
the plan for conducting a survey of graduates will mark the beginning of 
an expanded scientific effort for understanding the impact of Ohio Domini- 
can College upon its students. 
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Project Directors 

Mary Ann D. Sagarla Is an assistant professor In the Department of Educa- 
tional Policy and Leadership at The Ohio State University. She holds 
an Ed.D. In Higher Education and a B.A. In Pol ttlcal Science from the 
Pennsylvania State University^ and an M.Ed* In Student Personnel from 
the University of Miami* Dr. Sagarla Is the author of numerous arti- 
cles and monographs on such topics as college students* administra- 
tors' career development* and academic women. 

Philip E. Winger Is currently a doctoral cc^ndld^te In Educational Policy 
and Leadership at The Ohio State University. He Is also In his fourth 
year as a staff member of the National Association of Student Person- 
nel Administrators. He graduated from Westminster* College (Missouri) 
In 1977 with Bachelors' degrees In Sociology and Psychology* and from 
the University of Missouri-Columbia In 1979 with a Master's degree In 
Counseling and Personnel Services. 



Survey Subcoamlttee 

Sandra C* Burkhart completed her degree In Commun1c^:^t1ons/Advert1s1ng and 
Public Relations with a minor In French at Bowling Green State Univer- 
sity In 1984. She Is currently the Community Life Associate In the 
Olentangy Area Support and Information Services Office at Ohio State 
University* while working toward her Master's degree in College Stu- 
dent Personnel. 

Kathy J. Krajnak is currently a second-year Master's student in College 
Student Personnel* and holds an assistantship as the Learning Support 
Associate in the Olentangy Area Support and Informatioii Services 
Office. She is a 1984 graduate of Miami University with a major in 
psychology. 

Susan C Pollack graduated from the University of Cincinnati in 1981 with 
a degree in French Studies and a minor concentration in Judaic Stud- 
ies. She is presently a Master's student in the College Student 
Personnel program. 

Teresa E. West is presently an assistant to the Coordinator of the Ohio 
State University Off-Campus Student Center. She is also a second-year 
Master's student in College Student Personnel. In 1984* Teresa com- 
pleted her degree in Marketing and Public Administration* with a minor 
in Accounting* at Wilmington College. 
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PROJECT TEAM CONTINUED 



Comunlcatlons Subcommittee 

Irene M. Hytro graduated from The Ohio State University In 1972 with a 
degree In Business Administration. She Is presently a faculty member 
at Marlon Technical Institute, while wo.'king toward her Master's 
degree In Adult Education with a minor concentration In Educational 
Administration, 

Rodger C. Salth Is currently the Coordinator for Student Programs at The 
Ohio State University Mansfield Campus» while working toward his 
Master's degree In Educational Administration with a minor concen- 
tration In Communication. He graduated with a Bachelor's degree in 
education from The Ohio State University In 1972. 



iMplenentatlon Subcomilttee 

Gary Michael Tlako graduated from The Ohio State University In 1984 with a 
degree In English Education. He Is presently an Assistant Residence 
Hall Director and second-year Master's student In the College Student 
Personnel program at The Ohio State University. 

Sharon 0. Vaughters Is presently a Student Personnel Assistant at The Ohio 
State University Counseling and Consultation Serves» while In her 
second year as a Master's student In College Student Personnel. She 
graduated from Ohio Wesleyan University In 1980 with a degree In Music 
and Pre-Music Therapy. 



Drafting SubcoMlttee 

Jay D. Chopp currently works as a Graduate Administrative Associate In The 
Ohio State University Office of Residence Life. He Is also a second- 
year Master's student In College Student Personnel. In 1984, Jay 
completed his degree In Political Science with a minor In German at 
Marquette University. 

Scott R. Norton graduated from James Madison University in 1984 with a 
degree in Management. He is a second-year Master's student 'n College 
Student Personnel, with an assistantship as the Assistant to the 
Coordinator of Greek Affairs at The Ohio State University. 

Susan Konves graduated from Miami University in 1977 with a degree in 
mathematics. She completed her Master's degree in 1982, also at Miami 
University, in College Student Personnel. Susan is currently an 
Academic Advisor/Staff Assistant at The Ohio State University Mans- 
field Campus and is taking coursework to enhance her professional 
status and possibly, at some time, to pursue a terminal degree. 
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APPENDIX A 



Management Plan 

Survey Subcommittee 

Study existing research and Instrumentation 

Study Ohio Dominican College literature 

Analyze conversations with administrators 

Initial drafts of the questions 

Develop Introduction to questions 

Typing of draft 

Initial draft of questionnaire 

First pilot administration 

Revision and retyping 

Revision with entire class 

Typing 

Second pilot administration 
Revision 

Review and comments by Sister Suzanne Uhrhane and Mr. Sagona 
Final survey revisions and typing 

Communications Subcofrmlttee 

Obtain list of alumni for pilot studies 

Arrange for administration of Pilot Study I 

Administer Pilot Study I 

Arrange for administration of Pilot Study II 

Develop telephone script for Pilot Study II solicitation 

Telephone prospective participants 

Administer Pilot Study II 

Convey feedback to Survey Subcommittee 

Draft thank you notes to participants 

Type and mall thank you notes 

Deliver the revised survey to Sister Suzanne Uhrhane «nd Mr. Sagona 
Implementation Subcommittee 

Background work on survey research Implementation 

Discussions with Sr. Suzanne Uhrhane about possible sample 

Recommendations for the sample 

Recommendations for administration of the study 

Costing of the project 

First draft of Implementation section of report 
Revision of Implementation section 
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APPENDIX A CONTINUED 



Drafting Subcommittee 

Develop purpose and organization of report 
Create outline 

Meet with other subcommittees to solicit Input for report 
First draft 

Discussion of draft with project team 
Further drafting and revising 
Discussion of revisions with project team 
Final revisions 
Typing, copying, and binding 

HIscellaneQus 

Revise management plan 
Plan presentation 
Presentation of final report 
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APPENDIX B 
Final Draft of Survey 



OHIO DOMINICAN SURVEY OF GRADUATES 

We at Ohio Dominican College are concerned with providing a quality 
education and want to better understand how you feel about a wide variety of 
important issues concerning your undergraduate experience and your 
activities after college. You may be assured the confidentiality of your 
responses will be protected. 



An important purpose of this study is to learn more about our graduates. We 
would like to begin by asking you a couple of questions about yourself. 

Q-1 What year did you graduate? 

Q-2 What was your major? 
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Q-3 Next, we would like to ask about your views about O.D.C. Please 
indicate the extent to which you agree with the following statements 
(circle one number for each item). 



Strongly 

Disagree Disagree 



If given the chance to choose a 

college again, I would 

choose OOC 



If I started college again, I 
would choose to graduate with 
the same major 



I would recommend OOC to other 
college-bound students 



OOC provides quality education. 

OOC fulfilled my academic 
expectations of what a college 
would be 



I would be pleased to send my 
children to OOC 



The OOC Viewbook and College Catalogue 

accurately represented 

the institution 

I was satisfied with the personal 
attention received from faculty 
at OOC 

I was satisfied with my social 
life at OOC 



I was satisfied with the amount 

of financial aid I received 

at OOC 

I believe OOC enhanced my religious 
development 

I was pleased to be a student of 
a multicultural school 



I believe that ODC enhanced my 
occupational success 



2 
2 

2 
2 



2 
2 

2 
2 
2 
2 



Agree 



3 
3 

3 
3 



3 
3 

3 
3 



Strongly 
Agree 



4 
4 
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strongly 

Disagree Disagree 



Strongly 
Agree Agree 



I value the liberal arts education 
I received at ODC 



I have maintained contact with 
many of my friends from ODC — 



I am proud to be an alumnus of 
OOC 



2 
2 
2 



3 
3 
3 



4 
4 
4 



0-4 Ohio Dominican offers a variety of services to students. Please 
Indicate your satisfaction with services that you used as a student. If 
you were not aware of a service or It was not available while you were 
enrolled, please indicate by placing a check mark by the item. 



Very 



Very Did Not 



Low 


Low 


Moderate 


HM 


HM 


yse 


Admissions Off ice.. 1 


2 


3 


4 


5 


0 




2 


3 


4 


5 


0 


Academic 

Development Center. 1 


2 


3 


4 


5 


0 


International 
Student Serv1ces...l 


2 


3 


4 


5 


0 


Financial Aid 
Office 1 


2 


3 


4 


5 


0 


Career Information 


2 


3 


4 


5 


0 


Counseling and 
Testing Services... 1 


2 


3 


4 


5 


0 


Student Health 


2 


3 


4 


5 


0 


Audiovisual 

Center (AVC) 1 


2 


3 


4 


5 


0 


Campus Ministry 1 


2 


3 


4 


5 


0 


Residence Halls.... 1 


2 


3 


4 


5 


0 


Rathskellar 


2 


3 


4 


5 


0 
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Very 
Low 



Low Moderate High 



Office of the 
Registrar 



1 

Honors Program 1 

Academic Advising. .1 



2 
2 



3 
3 
3 



4 
4 
4 



Very 
High 



5 
5 
5 



Did Not 
Use 



0 
0 
0 



Q-5 ODC offers several organizations that function to serve the entire 
student body. 

In your experience at ODC, did you participate in any Student 
Organization(s)? (Please circle) 

1 No (Please continue to the question on the following page) 

2 Yes 

Please list the student organizations/activities in which you 
participated. Then indicate your level of satisfaction in each. 



Activity 



Very 
Low 



Level of Satisfaction 



Low 
2 
2 
2 
2 
2 



Moderate 
3 
3 
3 
3 
3 



HM 



Very 
High 

5 

5 

5 

5 

5 
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Q-6 College aids in the development of certain abilities, skills, and 
competencies. In the first column, please circle the number that 
represents the extent to which each item is desirable for success in 
your current endeavors. In column two please circle the number that 
represents how much your experience at Ohio Dominican College 
contributed to your success in each of the following areas. 



Desirable for 
Success in Your 
Current Endeavors 



Contribution of ODC 
to Your Success in 
Current Endeavors 



Very Very 
Little Moderate Much 



Very Very 
Little Moderate Much 



Writing effectively 

Ability to express 
ideas 

Speaking effectively 

Understanding written 
information 

Communicating to the 
public 

Ability to think 
critically and 
analytically 

Defining and solving 
problems 

Making logical 

decisions 

Formulating creative 
and original ideas 

Ability to market my skills 
and talents to potential 
employers 

Understanding world, 
social, political, and 
economic issues 

Understanding and 
applying mathematical 
principles 



3 
3 



2 
2 



2 
2 
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Understanding the nature 
of science and 
experimentation 

Ability to use 
computers 

Knowldege of specifics 
in my major or 
professional field 

Understanding 
different philosophies 
and cultures 

Appreciation of 
individual 

differences 

Ability to interact 
with culturally 
different people , . 

Acquiring new skills and 
understanding on my own 

Persistence at tasks 

Organizing time 
effectively 

Ability to function as 
a team member 

Leading/guiding/ 
supervising others 



Desirable for 
Success in Your 
Current Endeavors 

Very Very 
Little Moderate Much 



2 
2 

2 

2 

2 



3 
3 

3 

3 

3 



Contribution ofODC 
to Your Success in 
Current Endeavors 

Very Very 
Little Moderate Much 



2 

2 

2 

2 
2 



3 
3 

3 

3 

3 
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Q-7 How much did your experience at Ohio Dominican contribute to your 
personal growth in the following areas: 



Develop a personal understanding of the values 
in your life , 

Develop a personal philosophy by which 

to conduct your life 



Develop an appreciation of differences among 
people , 



Develop a moral and ethical commitment. 
Develop ethical standards 



Develop an awareness of different philosophies 
and ways of life , 



Develop the ability to cope with complex moral 
and ethical issues 



Very Very 
Little Moderate Much 



2 

2 

2 
2 
2 

2 

2 



3 

3 

3 
3 
3 

3 

3 



Q-8 In your experience since graduating from Ohio Dominican College, 
approximately how often have your participated in each of the following 
activities. Indicate your response by circling the appropriate number. 



Very 

Never Occasionally Often Often 



Voted in elections 

Participated in community government.. 

Volunteered at community institutions.. 

Read a book 

Attended a concert 

Went to the theater 

Vlsite^ museums and art galleries 

Contributed to charity/religious 
organizations 



Signed a petition, 
Used a library 



0 

2 
2 
2 
2 
2 
2 

2 
2 
2 



3 
3 
3 
3 
3 
3 

3 
3 
3 



4 
4 
4 
4 

4 

4 
4 

4 
4 
4 
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Very 

Never Occa^lonany Often Often 



Visited an exhibition 



2 



3 



4 



Read a newspaper 



2 



3 



4 



Discussed current events 



2 



3 



4 



Attended religious services 



2 



3 



4 



Q-9 Next, we are interested in learning about your current activities and 
the role of the college in preparing you for your occupation. Please 
check the appropriate response* 

Which of the following best describes what you are currently doing? 

1 Employed full-time 

2 Employed part-time 

3 Self-employed 

4 Serving in the armed forces 

5 * Continuing my education 

6 Employed and continuing my education 

7 Caring for a home/family 

8 Unemployed 

9 Other (please specify) 

What is the name of your current place of employment? 



What is your current job title? 

If you went ;rom college directly into graduate school, please indicate 
the name of the institution and your major field of stuc ' in graduate 
school. 



Please indicate the sources that helped you learn about your first job 
upon graduation from OOC or your selected graduate institution (circle 
all the appropriate items). Indicate the importance of the sources you 
circled by rank ordering them beginning with 1 as the most important. 

1 College placement office 

2 Faculty at college ZIZI 

3 An OOC graduate 

4 Relative or friend 

5 Newspaper/publication 

6 Professional meeting 

7 A friend 

8 Recruited by employer 

9 Employment agency 

10 Other (please specify) 
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If you desired to directly enter the job market upon graduation from 
OOC, how long did it take you to obtain your first Job (Circle one)? 



1 Obtained job prior to leaving college 

2 Less than one month after leaving college 

3 1 to 3 months after leaving college 

4 4 to 6 months after leaving college 

5 7 to 12 months after leaving college 

6 More than 12 months after leaving college 

7 Not applicable 

Circle the number of full-time jobs you have held since leaving Ohio 
Dominican (Circle one). 

1 
2 
3 
4 

5 or more 

How related is your college major to your current employment or advanced 
studies program (Circle one)? 

1 Not related 

2 Slightly related 

3 Moderately related 

4 Highly related 

How satisfied are you with your present job (Circle one)? 

1 Not satisfied 

2 Somewhat satisfied 

3 Satisfied 

4 Very satisfied 

How well did Ohio Dominican prepare you for your present occupation 
(Circle one)? 

1 Poorly 

2 Adequately 

3 Well 

4 Very well 

Which aspect of your experience at Ohio Dominican was more influential 
in your choice of a career? 

1 Academic studies 

2 Extracurricular activities 

3 College work experience 

4 Other (please specify) 
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Q'lO Lastly, we are interested in some background information about you 
to assist us to interpret the results. 

During your years at OOC, what was your marital status? 

1 Single 

2 Harried 

3 Member of Religious Community 

4 Other (please specify)^ 



What is your race or ethnic origin? 

1 American Indian 

2 Asian or Pacific Islands 

3 Black 

4 Hispanic 

5 White 

6 Other (please specify) 



With which of the following organized religious denominations do you 
currently identify? 

1 Baptist 

2 Episcopal 

3 Jewish 

4 Lutheran 

5 Methodist 

6 Presbyterian 

7 Roman Catholic 

8 Other (please specify) 

9 None 

Age Sex 



Were you enrolled part-time 
full-time 
both 



During years at GDC were you a: 

1 resident student 

2 commuting student 

3 both (at some time during college) 

Did you transfer to Ohio Dominican College? 

1 No 

2 Yes 

How many years did you attend Ohio Dominican College? 
2 

O 

4 

5 or more 
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It has been impossible for us to address all issues and concerns regarding 
your experience at Ohio Dominican. In the space provided below, please 
comment upon any aspect of your experience at Ohio Dominican which you find 
Important to share. We welcome your suggestions 



Thank you for taking the time to make your views known, 
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Communication Committee 
Interview Guide 
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REACTION SHEET 



INTRODUCTION: We greatly appreciate your Interrupting your busy schedule to 
assist us In developing an alumni survey. Now that your have completed this 
questionnaire, we would like to ask you about your reactions to It. Your 
comments are especially Important so that we can Improve the survey to best 
assess the alumni reaction to their undergraduate experiences. 

Overall, what Is your reaction to the survey? (Format, clarity of 
Instructions, organization, appearance, length, sequence of questions.) 



What questions are not clear? 



Old you find any questions objectionable? 



What other questions should we include? 



What questions seemed Irrelevant? 



Were there questions that seemed biased or led you to a particular answer? 



What should we do to have a high response rate from the alumni? 
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APPENDIX C 

Telephone solicitation Script 
(used to solicit volunteers for pilot Implementations) 



Hello. I'm , I am part of an Ohio State University 

research group working on an Alumni Survey for Ohio Dominican College. 
The Ohio Dominican President's Office and Alumni Records Office have 
provided your name as part of a select group of fifteen Alumni to become 
members of a pilot study group on Alumni views of undergraduate education- 
al experiences. 

We are asking for one hour of you time to complete the survey and talk 
briefly to us about it. The time options would be Thursday* 7 to 8 p.m. 
or Saturday, 10 - 11 a.m., in St. Albert's Hall at the Ohio Dominican 
campus. Could we count on your participation? Please select a time now. 
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APPENDIX D 



0 




Thank You Letter to Pilot Study Participants 
The Ohio State University 



Department of 

Educational Policy and Leadership 
College of Education 

121 RamseyerHall 

29 West Woodruff Avenue 

Columbus, Ohio 43210-1177 

Phone 614-422-5181 



August 1 , 1985 



Ms. Margie Bogenschutz 
202 Lakeview 
Columbus, OH 43202 

Dear Ms. Bogenschutz: 

Thank you for taking time out of your busy schedule to assist us in 
developing a survey about graduates' perceptions of Ohio Dominican 
College* By completing the questionnaire and sharing your opinions 
about the study you have contributed to the quality of our effort to 
collect important information from alunmi and alumna. 

The results of our research are being made available to officials of 
O.D.C. These will enable them to undertake a large study to learn 
what kinds of experiences people like yourself have had at the 
College and how those experiences influence life after college. 
Information from the study will have important policy implications 
for enhancing the quality of education at Ohio Dominican. 

We greatly appreciate your assistance. 



sincerely. 




MADS/kls 
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PROQRAM AREAS 

Curricuium, instruction and 
DevebpfTTent 
121 RamseyerHail 
J1 4-422-51 81 



Educationai Administration 
301 Ramseyer HbA\ 
614-422-7700 
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Higher Education, Student 
Affairs ana Adult Eoucation 
301 Ramseyer Hail 
614422-7700 
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Humanistic Foundations 
121 Ramseyer Haii 
614-422*5181 



Vocationaf-Technical 
Education 
160Rambeyer Halt 
614422-5037 



APPENDIX E 
FtlQt Study FeedbdcK Form 



INTRODUCTION: We greatly appreciate your Interrupting your busy schedule 
to assist us In davel oping an alumni survey. Now that you have completed 
this questionnaire^ we would like to ask you about your reactions to It* 
Your comments are especially Important so that we can Improve the survey 
to best assess the alumni reaction to their undergraduate experiences* 

Overalls what Is your reaction to the survey? (Formats clarity of Instruc- 
tlonsf organization^ appearance, length, sequence of questions). 



What questions are not clear? 
Did you find any questions objectionable? 
What other questions should we Include? 
What questions seemed Irrelevant? 

Were there questions that seemed biased or led you to a particular answer? 
What should we do to have a high response rate from the alumni? 
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